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Abstract — Low-density parity-ciieclf (LDPC) convolutional 
codes (or spatially-coupled codes) have been shown to approach 
capacity on the binary erasure channel (BEC) and binary-input 
memoryless symmetric channels. The mechanism behind this 
spectacular performance is the threshold saturation phenomenon, 
which is characterized by the belief-propagation threshold of 
the spatially-coupled ensemble increasing to an intrinsic noise 
threshold defined by the uncoupled system. 

In this paper, we present a simple proof of threshold saturation 
that applies to a broad class of coupled scalar recursions. The 
conditions of the theorem are verified for the density-evolution 
(DE) equations of irregular LDPC codes on the BEC, a class 
of generalized LDPC codes, and the joint iterative decoding of 
LDPC codes on intersymbol-interference channels with erasure 
noise. Our approach is based on potential functions and was 
motivated mainly by the ideas of Takeuchi et al. The resulting 
proof is surprisingly simple when compared to previous methods. 

Index Terms — convolutional LDPC codes, spatial coupling, 

■ threshold saturation, density evolution, potential functions 

I. Introduction 

Convolutional low-density parity-check (LDPC) codes, or 
[ spatially-coupled (SC) LDPC codes, were introduced in lU 

■ and shown to have excellent belief-propagation (BP) thresh- 
olds in f2\, f3\, f4\. Moreover, they have recently been 
observed to universally approach the capacity of various 
channels 0, EJ, 0, Q, JS], M, M, Ell- 

The fundamental mechanism behind this is explained well 
I in lfT2l . where it is proven analytically for the BEC that the 

■ BP threshold of a particular SC ensemble converges to the 
maximum-a-posteriori (MAP) threshold of the underlying en- 
semble. This phenomenon is now called threshold saturation. 

I A similar result was also observed independently in [13] and 

■ stated as a conjecture. The same result for general binary 
memoryless symmetric (BMS) channels was first empirically 
observed ||4], and recently proven analytically |ir|. 

The underlying principle behind threshold saturation ap- 
pears to be very general and it has now been applied, with 
much success, to a variety of more general scenarios in 
information theory and coding. In fR\, the benefits of spatial 
coupling are described for iC-satisfiability, graph coloring, 
and the Curie-Weiss model in statistical physics. SC codes 
are shown to achieve the entire rate-equivocation region for 
the BEC wiretap channel in |6|. The authors observe in [7] 
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that the phenomenon of threshold saturation extends to multi- 
terminal problems (e.g., a noisy Slepian-Wolf problem) and 
can provide universality over unknown channel parameters. 
Threshold saturation has also been observed for the binary- 
adder channel ifTSl . for intersymbol-interference channels (S), 
im, ifTOl . for message-passing decoding of code-division mul- 
tiple access (CDMA) lfT6l . IfTTl . and for iterative hard-decision 
decoding of SC generalized LDPC codes ITSl . For compres- 
sive sensing, SC measurement matrices were investigated first 
with verification-based reconstruction in [19], and then proved 
to achieve the information-theoretic limit in 1120 1 . 

In many of these papers it is conjectured, either implicitly 
or explicitly, that threshold saturation occurs for the studied 
problem. A general proof of threshold saturation (especially 
one where only a few details must be verified for each 
system) would allow one to settle all of these conjectures 
simultaneously. In this paper, we provide such a proof for 
systems with scalar density-evolution (DE) equations. 

Our method is based on potential functions and was mo- 
tivated mainly by the approach taken in 121]. It turns out 
that their approach is missing a few important elements and 
does not, as far as we know, lead to a general proof of 
threshold saturation. Still, it introduces the idea of a potential 
function defined by an integral of the DE recursion and this 
is an important element in our approach. More recently, a 
continuum approach to DE is used, in Il20l . to prove threshold 
saturation for compressed sensing and was reported informally 
to give a general proof |22|. 

II. A Simple Proof of Threshold Saturation 

In this section, we provide a simple proof of threshold 
saturation via spatial-coupling for a broad class of scalar recur- 
sions. The main tool is a potential theory for scalar recursions 
that extends naturally to coupled systems of recursions. 

A. Single-System Potential 

First, we define potential functions for a class of scalar 
recursions and discuss threshold parameters associated with 
the potential. 

Definition 1: An scalar admissible system {f,g) parame- 
terized by e 6 [0, 1], is defined by the recursion 



(1) 



where / : [0, 1] x [0, 1] -* [0, 1] is strictly increasing in 
both arguments for x,e e (0,1], and g : [0,1] -* [0,1] 
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Figure 1. The potential function of tiie (3,6)-regular LDPC ensemble is 
shown for a range of e. Here s* « 0.4294, e* 0.4881, and the stationary 
points are marked. Notice that, for e < e*, U{x\£) has no stationary points. 

satisfies g'{x) > for x e (0,1). We also assume that 
/(0;£) = f{x;0) = g{0) = and that f,g have continuous 
second derivatives on [0, 1] w.r.t. all arguments. 

Definition 2: The potential function U {x; e) of a scalar 
admissible system (/, g) is defined by 

U{x;e)= f\z-f{g{z)-e))g'{z)dz 
Jo 



xg{x) - G{x) - F{g{x);e), 



(2) 



where F{x: e) = f{z;e)dz and G{x) = f^il' g{z)dz. 

Definition 3: For x,e e [0, 1], we have the following terms. 

. For fixed e, x is a fixed point (f.p.) iff x = f{g{x);e). 
. For fixed e, a; is a stationary point (s.p.) if U'{x;e) = 0. 
. For < x < f{g{x); 1), we define e{x) to be the unique 
e-root of the equation x - f{g{x);e) = 0. 

Lemma 1: The potential function of a scalar admissible 
system has the following properties: 

1) U{x;e) is strictly decreasing in e, for e e (0, 1]. 

2) An X € [0, 1] is a f.p. iff it is a s.p. of the potential. 

Proof: These properties hold because the potential func- 
tion is the integral of {z - f{g{z);e))g'{z) w.rt. z, which is 
strictly decreasing in e, for e e (0, 1], and zero iff z is a fixed 
point of the recursion. ■ 
Definition 4: The single-system threshold is defined to be 

£* =sup{e€ [0,1] I U'{x;e) > V a; e (0, 1]} , 

and is the e-threshold for convergence of the single-system 
recursion to 0. It is well defined because U'{x;e) is strictly 
decreasing in e. This implies that, for e < £*, (HJ has no 
fixed points in (0, 1]. For DE recursions associated with BP 
decoding, the threshold e* is called the BP threshold. 

Example 1: For the standard irregular ensemble of LDPC 
codes (e.g., see ll23l ). the DE recursion. 
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is an scalar admissible system with f{x;e) = eX{x) and 
g{x) = 1 - p{l - x). In this case, the single-system potential 
is given by (|6]l and is shown in Fig. [T]for the (3, 6)-regular 
LDPC code ensemble defined by {X,p) = {x^,x^). 
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Figure 2. A portion of a generic SC system. The /-node at position i is 
coupled with the g-nodes at positions i, . . . ,i + ui - 1 and, by reciprocity, 
g-node at position i is coupled with the /-nodes at positions i-w + 1, . . . ,i. 
Here, tt; and 7r^ are random pennutations. 

Definition 5: For £ > £*, we define the minimum unstable 
fixed point to be 

u{e) =sup{i € [0,1] I C/'(x;£) >0,a;£ [0,5]}. 
Definition 6: Let the potential threshold of the system be 
£* =sup{£€ [0,1] I min C/(a;;£) >0} (3) 

and AE{e) = min^i=[u(e),i] U{x;e) be the energy gap of the 
system for e e (e*, 1]. 

Remark 1: One consequence of this definition is that, if 
£<£*, then U{x;e)>0 for x e (0, 1]. Likewise, if A£'(£) = 0, 
then £ = £*. For DE recursions associated with BP decoding, 
the potential threshold is analogous to the threshold predicted 
by the Maxwell conjecture ll241 Conj. 1]. 

B. Coupled System Potential 

Now, we extend our definition of potential functions to 
coupled systems of scalar recursions. In particular, we consider 
a "spatial-coupling" of the single-system recursion, ([T]i, that 
gives rise to the vector recursion (|4). For the vector recursion 
of the coupled system, we define a potential function and show 
that, for £ < £*, the only fixed point of the coupled system is 
the zero vector 

Definition 7 (cf. [12]): The basic spatially-coupled system 
is defined by placing 2L + 1 single systems at positions in 
the set Co - {-L,-L + 1,...,L} and coupling them with 
w systems as shown in Fig. |2] Let x^^"* be the input to the 
^-function in the i-th position after £ iterations and define 



OfoviiC = {-L,-L + l,. 



■ w 



1} and all t For 



the coupled system, we have the recursion 



1 



w-l 



w-1 



-E/ -Eff( 



W 



k=0 



3=0 



(4) 



where £; = £ for i e £o and £j = for i ^ Cq. 

Definition 8: The recursion defined by (|4) can be rewritten 
as a vector recursion. Let f{x\ e) and g{x) be defined for vec- 
tor arguments by [f{x;£)], = f{xi;e) and [g{x)]i = g{x{), 
respectively. Then, (HJi is equivalent to 

a;(^-i) = A^/(A2g(=rW);£), 

where A2 is the (2L + 1) x (2L + w) matrix given by 
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Remark 2: In contrast to [12], the SC recursion defines a;^^-* 
to be the SC-average of the /-function (e.g., bit node in the 
LDPC example) output values rather than the output values. 
Since there are 2L+1 active /-function outputs, the vector x^^^ 
contains the 2L + w active averaged values after convolution 
with the length-w averaging sequence. This also shifts the 
maximum value of the vector from position 0, in ifTZl . to 
position io - [-^^J in this work. 

One might also expect that A2 is square and that all rows 
and columns should sum to 1, but the termination leads to 
a rectangular matrix with reduced column sums near the 
boundaries. In particular, A2g{x) is a length 2L + 1 vector 
representing the inputs to the 2L + 1 active /-functions. 

Definition 9 (cf. fT2\]): The one-sided spatially-coupled 
system is a modification of (01 defined by fixing the values of 
positions outside C = {-L, L + 1,. . . , iq}, where io = [^^J 
is the position of the maximum element of x^^\ It fixes the 
left boundary to zero by defining x^^"* = for i < -L and 
all £. It forces the right boundary to a floating constant by 
setting x^^'' = x^^^^ for i > io and all £. 

Definition 10: Let the vector one-sided SC recursion be 

a;(^^i)=AV(Ag(a;(^));e), (5) 

where x^^^ = [x^^^_^, . . . ,x^2l+i(^ ^ (L + 3u; + «o + 

1) X {L+iw+iQ + l) matrix given by 



A = - 

w 
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Remark 3: The right hand side of (|5]l accurately represents 
a single iteration of the one-sided SC system update for i e C', 
but cannot be used recursively unless the boundary condition 
x^^"* = a:^^' for z > iq is enforced after each step. 

Lemma 2 (cfi l[T2\ Lem. 14]): For both the basic and one- 
sided SC systems, the recursions are component-wise decreas- 
ing with iteration and converge to well-defined fixed points. 
The one-sided recursion is also a component- wise upper bound 
on the basic SC recursion for i e C and it converges to a non- 
decreasing fixed-point vector. 

Proof: The proof follows easily from the arguments in 
lfT2l Sec. V] and is, hence, omitted. ■ 

Definition 11: The coupled-system potential can be com- 
puted for general vector recursions written in the form of 



Integrating a scaled version of the vector update step along a 
curve C, from to x, gives the potential function 

U{x;e) = f g'{z){z-A'f{Ag{z);e))-dz 
Jc 

= g{xyx-G{x)-F{Ag{x);e), 

where g'{x) = diag{[g'{xi)]), G{x) = f^g{z) ■ dz = 
T,iG{xi) and F{x;e) = f^f{z-,e) ■ dz = T,iF{xi;e). 

Remark 4: A key observation in this paper is that a potential 
function for coupled systems can be written in the simple 
form in Def. [TT| Remarkably, this holds for general coupling 
coefficients because of the A,A'^ reciprocity that appears 
naturally in SC. 

Lemma 3: Let xe [0, 1]" be a non-decreasing vector gen- 
erated by averaging z e [0, 1]" over a sliding window of 
size w. Let the shift operator S ■ ^ M" be defined by 
[Sa;]j^ = and [Sa;]^ = Xi-i for i > 2. Then, one can show 
ll^a; - a;|l < — and \\Sx - xL = x„ = ||a;||cx>. 



■x\\ < — and II ^a; ■ 

1 00 ^ II I.J. 

Proof: The bound || Sx - x \\ 



follows from 



■Xi-i 



1 V"^"*^ - 



where Zi = for all i < 0. Since x is non-decreasing, the 
1-norm sum telescopes and we get US' a; - x\\i = \0 - xi\ + 

^2=2 1*^4— 1 ~ "^^l ~ '^n ~ II a? II 00. B 

Lemma 4: For the vector one-sided SC system, a shift 
changes the potential by U{Sx;e) -U{x;e) = -U{xig;e). 

Sketch of Proof: First, we rewrite the potential as the 
summation 

U{x;e) = Y.T=Zu, [g{x^)x.-G{x.)-F{[Ag{x)l;e)] . 

One can verify that the contribution, from the first two terms in 
the square brackets, to U {Sx; e)-U {x; e) is a telescoping sum 
that leaves only the difference between the first and last values. 
For the third term in the square brackets, more care is required. 
Since the first w values of x are and the last 2w + l values of 
X equal Xi^, it can be shown that ZiI^L*-u) ^ {[-^9(^^)]ij^)~' 
F {[Ag{x)l;e) = F{g{0);e) - F{g{x,„);e). Thus, we have 

UiSx;e)-Uix;e) = -Uix,,;e). ■ 

Lemma 5: For the SC potential, the norm of the Hessian 
U"{x;e) is independent of L and w and satisfies 



,'l|2 



\\U"ix;e)\\^<Kf^g = \\g'U + \\g'\\l\\fU + \\g- 

where \\h\\oo = sup^-^^Q \h{x)\ for functions ft, : [0, 1] ^ I 
Proof: One can verify that the Hessian is given by 

U"{x;e) = g'{x) - {Ag'{x)y f'{Ag{x);e)Ag'{x) 
+ g"{x)dmg{x-A^f{Ag{x);e)), 

where g"{x) = diag([(7"(a;i)]). Taking the norm gives 

l|f/"(^;£)IL < ll9'(^)IL + \\f\Ag{xYe)\\ 
■ \\Ag'{x))\\^ + \\g"{x)dmg{x-A'f{Ag{x);e))\\^ 



Since ||A|L = |l^lli = l and ||g'(a:) L = |ls'(^) II 1 < 11.9' 
find that \\U"{x;e)\\^ < \\g'U+ ||ff'||i ||/'||oc + ||g"|U. 



we 



We now state the main result of the paper. Roughly speak- 
ing, it says that, if e < e* and w is sufficiently large, then one 
can always lower the coupled potential of a non-zero vector by 
shifting. Since this implies the next step of the recursion must 
reduce some value, the only fixed point is the zero vector 

Theorem 1: Consider a scalar admissible system {f,g)- If 
e < e* and w > K f g/ AE{e), then the only fixed point of the 
spatially-coupled system, defined by (HJi, is a; = 0. 

Proof: Using Lem. |2l let x be the unique fixed point of 
the one-sided recursion defined in Def. |9] This fixed point 
upper bounds the fixed point of the basic SC system defined 
in Def. I2I If a; Q, then Xi„ > u{e) because the system has no 
fixed points with Xi < u{e) for all i. From Lem. |4] we have 
AU = U{Sx;s)-U{x;e) = -U{x,„;e). Expanding U{Sx;e) 
in a Taylor series (with remainder) around U {x; e) gives 

U'{x;e)-{Sx-x) = U{Sx;e) -U{x;e) 

- [\l -t)(Sx - xyu"(x(t);e)(Sx - x)dt 
Jo 

<AU + \ f (1 - t)(Sx - xyU"(x(t);e)(Sx - x)dt 
I Jo 

<AU+\\Sx-x\\, max \\U"{x{ty,e) L \\Sx -x\\^ 

t6[0,l] 

< -U{xi„;e) + ^x^„ max \\U"{x{t);e)\\^ 

<-U{x,,-e) + ^Kf,g 
<-U{x,,;e)+AE{e)<0, 

where the last steps hold because w > K f g/ AE{e), Xi^ < 1, 
and U{x;e) > AE{e) for x > u{e). 

Now, we observe that Sx - x < (i.e., the fixed point is 
non-decreasing) and [Sx-x]i is zero for i i C. So, U'{x;e) 
is positive in at least one component (i.e., there exists i e C' 
such that [U'{x;e)]i > 0). Since g'{x) > and [U'{x;e)]i = 
g'{xi)[x - f{Ag{x);e)]i, it follows that g'{xi) > and 
[A^ f{Ag{x);e)]i < Xi. So, one more iteration must reduce 
the value of the i-th component for some i e This gives a 
contradiction and shows that the only fixed point of the one- 
sided SC system is a; = 0. The result follows since the fixed 
point of the basic SC system is upper bounded by this f.p. ■ 

III. Applications 

In this section, we consider some applications of Theorem[T] 
for coding problems that are characterized by a scalar recur- 
sion. We liberally use notation and definitions from 1,23] . 

A. Irregular LDPC Codes 

Consider the ensemble LDPC(A,p) and transmission over 
an erasure channel with parameter e. Let x^^^ be the fraction 
of erasure messages sent from variable to check nodes during 
iteration £. The DE equation can be written in the form of ([T]i, 
where f{x;e) = eX{x) and g{x) = 1 - p(l - a:;). It is easy 
to verify that / and g describe a scalar admissible system if 
A(0) = 0. The single system potential is given by 

U{x; e) = ^ (-P(x) + {e{x) - e)L{l - p{l - x))) , (6) 

where P{x) is the trial entropy defined in ll23l Def. 3.119], 

e{x) = x/\{l- p{l-x)) and L{x) = \{y)dy/ X{y)Ay. 



In this case, the potential U {x; e) is the same as the pseudo- 
dual of the Bethe variational entropy in [25 Part 2, pp. 62-65]. 

Lemma 6: Consider the potential threshold e* given by (O. 
Let e'^^" be the Maxwell threshold f24l Conj. 1], defined by 

e'^"" = min {£(2;) | P{x) = 0, x e [0, 1]} . (7) 

Then, e* = e"^" for the ensemble LDPC(A,p). 

Sketch of Proof: Let x^'^^ be the x-value that achieves 
the minimum. Then, © and O imply U{x^'''';e^'''') = 
U{x^'''';e{x^'''')) = -P{x^'''')/L'{l) = 0. One can show 
AE{e^"'') = [/(xi^"; e^'^'') = 0, which impHes e* = e"^^ ■ 

Remark 5: For regular ensembles, e'^^" equals the MAP 
threshold e'^^^ and this is conjectured to hold in general. 

Consider an SC ensemble of irregular LDPC(A,P) codes 
defined as follows. The /-nodes at each position are replaced 
by M copies of the node degree profile A(a;) = Y,i A^a;*, where 
Ai is the number of bit nodes of degree i. The (7-nodes at 
each position are replaced by M copies of the node degree 
profile P{x) = Y,i PiX^, where Pi is the number of check 
nodes of degree i. For sufficiently large M, these nodes can 
be coupled uniformly using an averaging window of length w 
(see Fig. |2]i in a manner similar to the (l, r,L,w) ensemble 
defined in H2J. 

Corollary 1: Applying Theorem [T] shows that, if e < e'^"" 
and w > K f g/ AE{e), then the SC DE recursion converges to 
the zero vector 

B. Generalized LDPC Codes on the BEC and BSC 

Consider a generalized LDPC (GLDPC) code with degree-2 
bits and generalized check constraints based on a BCH code of 
block-length n. For iterative decoding using bounded-distance 
decoding of the BCH code, the DE recursions can be derived 
for both the BEC and binary symmetric channel (BSC) 11 8J . 
On the BEC, the code is chosen to correct all patterns of at 
most t erasures and, on the BSC, the code is chosen to correct 
all error patterns of weight at most t. 

For both cases, the iterative decoding performance of 
this ensemble is characterized by a DE recursion of the 
form ([Til, where e denotes the channel parameter In this 
case, the scalar system is defined by f{x;e) = ex and 
g{x) = E"r/ ("_:^)a;^(l-a;)""i"^ ^^^^.^ ^ denotes the erasure 
(resp. error) probability of bit-to-check messages for the BEC 
(resp. BSC) case. 

It can be verified that / and g define a scalar admissible 
system whose single-system potential is given by U{x;e) = 
1{-P{x) + g{x){x - f{g{x);e))), where 

P(a;)=/;(.g(z))V(z)dz = -xg(a;)+2/;g(z)dz 

is the analogous to the trial entropy defined in [23 1. 

Lemma 7.- For 2 < f < J on the BEC, P{x) has an 
unique root, x, in (0, 1]. Let e = £{x) be the e-root, and e* 
be the potential threshold defined by Q. Then, e* = e for the 
GLDPC ensemble. 

Remark 6: Since this decoder uses suboptimal component 
decoders, the threshold defined by the unique zero of P{x) 
does not give an upper bound on the MAP threshold. 



We now describe the SC ensemble for the ensemble of 
GLDPC codes. The /-nodes in Fig. |2] are replaced by Mn 
degree-2 variable nodes and the g-nodes are replaced by 2M 
BCH codes of block-length n. These nodes are coupled using 
an averaging window of length w in a manner similar to the 
{l,r,L,w) ensemble defined in 1,12] (e.g., see [18]). 

Corollary 2: Applying Theorem [T| to this SC GLDPC en- 
semble shows that the SC DE recursion converges to the zero 
vector whenever e < e and w > K f gj /S.E{e). 

C. Intersymbol-Interference Channels with Erasure Noise 

In ||26| . a family of intersymbol-interference (ISI) channels 
with erasure noise is investigated as an analytically tractable 
model of joint iterative decoding of LDPC codes and channels 
with memory. Let ip{t;e) be the function that maps the a 
priori erasure rate t from the code and the channel erasure rate 
£ to the erasure rate of extrinsic messages from the channel 
detector to the bit nodes. Then, the resulting DE update equa- 
tion for the erasure rate, x^^\ of bit-to-check messages can be 
written in the form of where f{x;e) = i/j{L{x);e)X{x) 
and g{x) = 1 - p{l - x) 126]. This defines a scalar admissible 
system with potential 

U{x;e) = ^^^{L{g{x));e{x)) - 'f{L{g{x));e)-P{x), 

where e{x) and P{x) are defined in |0 for generaUzed erasure 
channels and 5'(a;;e) = il;{y;e)dy. 

Lemma 8: Consider the potential threshold e* defined by 
© and let e"'"' be defined by O. Then, e* = e"''^ If, in 
addition, P{x) has a unique root x e (0, 1], then g^^^ = 
is an upper bound on the MAP threshold and e* = e'^^^. 

Proof: Omitted due to similarity with Lem. |6] ■ 

Corollary 3: Consider the SC ensemble defined in Sec- 
tion |IlLA] If e < e* and w > Kf^g/AE{£), then Theorem □ 
shows that the SC DE recursion converges to the zero vector 

IV. Conclusions 

A new theorem is presented that provides a simple proof 
of threshold saturation for many scalar DE recursions. The 
conditions of the theorem are verified for the density-evolution 
(DE) equations of irregular LDPC codes on the BEC, a class 
of generalized LDPC codes, and the joint iterative decod- 
ing of some intersymbol-interference channels with erasure 
noise. Therefore, threshold saturation is now proved for these 
cases. Moreover, we believe this approach opens the door to 
threshold-saturation proofs for many more general spatially- 
coupled systems. 
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